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Abstract 

Let G be a symplectic or orthogonal complex Lie group with Lie algebra g. As a G-module, 
the decomposition of the symmetric algebra S(g) into its irreducible components can be ex- 
plicitcly obtained by using identities due to Littlewood. We show that the multiplicities appear- 
ing in the decomposition of the k-th graded component of S(g) do not depend on the rank n of g 
providing n is sufficiently large. Thanks to a classical result by Kostant, we establish a similar 
result for the k-th graded component of the space H(g) of G-harmonic polynomials. These 
stabilization properties are equivalent to the existence of a limit in infinitely many variables for 
the graded characters associated to S(g) and H(g). The limits so obtained are formal series 
with coefficients in the ring of universal characters introduced by Koike and Terada. 

From Hessclink expression of the graded character of harmonics, the coefficient of degree 
k in the Lusztig g-analogue K® ^ (q) associated to the fixed partition A thus stablizes for n 
sufficiently large. By using Morris- type recurrence formulas, we prove that this is also true 
for the polynomials K® ^(q) where /i is a nonempty fixed partition. This can be reformulated 
in terms of a stability property for the dimension of the components of the Brylinski-Kostant 
filtration. We also associate to each pair of partitions (A,/i) formal series Kf°^(q) and (q), 
which can be regarded as natural limit of the Lusztig g-analogues. One gives a duality property 
for these limits and obtains simple expressions when A is a row or a column partition. 

1 Introduction 

The multiplicity K\u of the weight /u in the irreducible finite-dimensional representation V s (A) of 
the simple Lie group G with Lie algebra q can be written in terms of the ordinary Kostant partition 
function V defined by the equality 



a positive root (3 



P 



where (3 runs on the set of nonnegative integral combinations of positive roots of 0. Thus V(f3) is 
the number of ways the weight f3 can be expressed as a sum of positive roots. Then, one derives 
from the Weyl character formula 

K l» = E (-1) £W ?XA + p) - (m + P)) (1) 
where W s is the Weyl group of q. 
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The Lusztig (/-analogue of weight multiplicity K® (q) is obtained by substituting the ordinary 
Kostant partition function V by its (/-analogue V q in (fTJ). Namely V q is defined by the equality 

n ^=E^ 

a positive root /3 

and we have 

K iM= E {-i) i{w) v q {w{x+p)-^+ P )). 

As shown by Lusztig [14j . ^(q) is a polynomial in q with nonnegative integer coefficients. Many 
interpretations of the Lusztig (/-analogues exist. In particular, they can be obtained from the 
Brylinski-Kostant filtration of weight spaces pQ. The polynomials K^^q) appear in the graded 
character of the harmonic polynomials associated to g [4]. We also recover the Lusztig (/-analogues 
as the coefficients of the expansion of the Hall-Littlewood polynomials on the basis of Weyl char- 
acters (see [lTj ) . This notably permits to prove that there are affine Kazhdan-Lusztig polynomials. 
In [11] Lascoux and Schiitzenberger have obtained a combinatorial expression for K® l ^(q) in terms 
of the charge statistic on the semistandard tableaux of shape A and evaluation [x. By using the com- 
binatorics of crystal graphs introduced by Kashiwara and Nakashima j5], we have also established 
similar formulas [12], [13] for the Lusztig (/-analogues associated to the symplectic and orthogonal 
Lie algebras when (A, p) satisfies restrictive constraints. 

Consider A, fi two partitions of length at most m. These partitions can be regarded as dominant 
weights for g = g[ n ,so 2n+ i,sp 2n or so 2n when n > m. Then, K^ n {q) does not depend on the rank n 
considered. Such a property does not hold for the Lusztig (/-analogues K® ^(q) when g = so 2n+1 , sp 2n 
or so 2n which depend in general on the rank of the Lie algebra considered. Write 

k>0 

We first establish in this paper that for g = so 2n+1 ,sp 2n or so 2ra , the coefficient K^ k stabilizes 

when n tends to the infinity. More precisely, K^ k does not depend on the rank n of g providing 
n > 2k + a where a is the number of nonzero parts of [i (Theorem 14.3. ip . By Brylinski's inter- 
pretation of the coefficients K^' k [I] , one then obtains that the dimension of the A;-th component 
of the Brylinski-Kostant filtration associated to the finite-dimensional irreducible representations 
of g — so 2n+1 ,sp 2n or so 2n stabilizes for n sufficiently large (Theorem [4 1 4 i 2]). Observe that this 
stabilization is immediate for g = g[ n since the polynomials K^(q) does not depend on n. For 
= S0 2n+i) s P2n or 50 2n the Brylinski-Kostant filtration depends in general on the rank considered 
and it seems difficult to obtain the dimension of its components by direct computations. 
Our methods is as follows. We obtain the explicit decomposition of the symmetric algebra S(q) 
considered as a G-module into its irreducible components by using identities due to Littlewood. 
This permits to show that the multiplicities appearing in the decomposition of the A;-th graded 
component of S(q) do not depend on the rank n of g providing n is sufficiently large. Thanks to a 
classical result by Kostant, we establish a similar result for the fc-th graded component of the space 
H(q) of G-harmonic polynomials. These stabilization properties is equivalent to the existence of 
a limit in infinitely many variables for the graded characters associated to 5(g) and H(q). The 
limits so obtained are formal series with coefficients in the ring of universal characters introduced 
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by Koike and Terada. From Hesselink expression [1] of the graded character of H(q), one then 
derives that K®'q stabilizes for n sufficiently large. By using Morris-type recurrence formulas for 

the Lusztig g-analogues [15] , we prove that this is also true for the coefficients Kff where \i is 
a nonempty fixed partition. We also observe that these formulas permit to give an explicit lower 
bound for the degree of the g-analogues K®' (q) such that K®' (q) ^ 0. We establish that the limits 

of the coefficients K s °^ +1 ' k and K s °^ +1 ' k are the same. Write K~^' and K^' respectively for the 

limits of the coefficients j{^°'^ i + 1 ' k an( j K^ p ^ i n,k when n tends to the infinity. 

The stabilization property of the coefficients K^' suggests then to introduce the formal series 

= £*CV and = 5>*V. 

k>0 k>0 

These series belong N [[<?]] and can be regarded as natural limits of the polynomials (q). We 
establish a duality result between the formal series K^^(q) and K^(q) (Theorem 15.3. ID . Namely, 
we have 

K%(q) = Kf/q) (2) 

where A' is the conjugate partition of A. Note that ([2]) do not hold in general if we replace the 
formal series K*°^(q) and K^(q) by the polynomials K^'*(q). We also give recurrence formulas 
(f38l) . (i39j) for the series (q) and K^(q). Thanks to these recurrence formulas, one derives 
simple expressions for the formal series K^(q) when A is a row or a column partition (Proposition 
I5.4.ip . Note that we have not find so simple formulas for the Lusztig g-analogues (q) even in 
the cases when A is a column or a row partition. Moreover the duality ([2j) is false in general for 
the polynomials K?(q). This suggests that the study of the series K^°^(q) and K*jf (q) which is 
initiated in this paper, could be easier than that of the Lusztig g-analogues. 

The paper is organized as follows. In Section 2 we recall the necessary background on symplectic 
and orthogonal Lie algebras, universal characters, and Lusztig g-analogues which is needed in the 
sequel. In Section 3 we introduce universal graded characters as limit in infinitely many variables 
for the graded characters associated to 5(g) and H(q). We obtain the stabilization property of 
the coefficients Kff in Section 4 and reformulate this result in terms of the Brylinski-Kostant 
filtration. In Section 5, we introduce the formal series K^^(q) and K^(q), establish recurrence 
formulas which permit to compute them by induction, prove the duality ([2]) and give explicit 
formulas for Kff^q) and K^(q) when A is a row or a column partition. Finally in Section 6 we 
have added a few considerations on the possibility to define Hall-Littlewood polynomials from the 
formal series K^^(q) and K^(q). 



2 Background 

2.1 Convention for the root systems of types B, C and D 

In the sequel G is one of the complex Lie groups Sp2 n , S02 n +i or S02 n and g its Lie algebra. We 
follow the convention of [7] to realize G as a subgroup of GL^ and q as a subalgebra of gi N where 

2n when G = Sp2 n 
Y { 2n + 1 when G = S0 2n +i ■ 
2n when G = S02 n 
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With this convention the maximal torus T of G and the Cartan subalgebra f) of g coincide re- 
spectively with the subgroup and the subalgebra of diagonal matrices of G and g. Similarly the 
Borel subgroup B of G and the Borel subalgebra b + of g coincide respectively with the subgroup 
and subalgebra of upper triangular matrices of G and g. This gives the triangular decomposition 
= b + © f) © b_ for the Lie algebra g. Let ej, hi, fi, i G {1, n} be a set of Chevalley generators 
such that ej G b+, /ij G f) and /j G b_ for any i. 

Let djv be the linear subspace of gl N consisting of the diagonal matrices. For any i G {l,...,n}, 
write £j for the linear map Ei : cZat — > C such that £j(.D) = <5j for any diagonal matrix D whose 
(i, ^-coefficient is Si. Then (ei, ...,e n ) is an orthonormal basis of the Euclidean space f)jjj (the real 
part of f)*). We denote by < • > the usual scalar product on f)jjj. 

Let R be the root system associated to G. We can take for the simple roots of g 

S + = {a n = e n and ctj = £j — £«+i, i = 1, n — 1 for the root system B Tt } 
< S + = {a ra = 2e ra and a« = £j — £j+i, i = 1, n — 1 for the root system C n } . (3) 

S + = {q„ = e n + £ n _i and aj = £j — £«+i, i = 1, n — 1 for the root system D ra } 

Then the sets of positive roots are 

i? + = {ei — £j,£i + £j with 1 < i < j < n} U {£« with 1 < i < n} for the root system B n 
R + = {£j — £j,£i + Ej with 1 < i < j < n} U {2£j with 1 < i < n} for the root system C n . 
R + = {Ei — Ej, Ei + Ej with 1 < i < j < n} for the root system D n 

We denote by R the set of roots of G. For any a G i?, let a v = <q " q> be the coroot corresponding 
to a. The Weyl group of the Lie group G is the subgroup of the permutation group of the set 
{n, 2, 1, 1, 2, n} generated by the permutations 

J Si = + l)(i, i + 1), « = 1, n — 1 and s n = (n, n) for the root systems B n and C n 

\ Si = + l)(i, i + 1), i = 1, n — 1 and = (n, n — l)(n — 1, n) for the root system D n 

where for a ^ b (a, b) is the simple transposition which switches a and b. We identify the subgroup 
of W s generated bysj = (i, i+ i + 1), i = 1, n — 1 with the symmetric group S n . We denote 
by £ the length function corresponding to the above set of generators. The action of w G W s on 
P = (Pi, -,P n ) G f)R is defined by 

w(P 1 ,...,P n ) = (P?- 1 ,...,P%- 1 ) 

where Pf = P w ^ if w(i) G {1, ...,n} and /3f = —P w q\ otherwise. We denote by p the half sum of 
the positive roots of R + . The dot action of W e on (3 = —,P n ) G f)J is defined by 

w o P = w ■ (P + p) — p. (4) 

Write P and P + for the weight lattice and the cone of dominant weights of G. As usual we consider 
the order on P defined by P < 7 if and only if (3 — 7 G Q + . 

For any positive integer m, denote by V m the set of partitions with at most m nonzero parts. Let 
V m (k), k G N be the subset of V m containing the partitions A such that |A| = Ai + • • • + A m = k. 
Set V = yj m& {Pm and V m [k] = U a < k V m (a). 

Each partition A = (Ai, A n ) £P„ will be identified with the dominant weight Y17=i ^i £ i- Then the 
irreducible finite-dimensional polynomial representations of G are parametrized by the partitions 
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of V n . For any A G V n , denote by ^ 9 (A) the irreducible finite-dimensional representation of G of 
highest weight A. The representation V 8 (l) associated to the partition A = (1) is called the vector 
representation of G. For any weight (3 G P and any partition A G V n , we write V s (\)p for the 
weight space associated to (3 in V S (X). 

We denote by Q the root lattice of and write Q + for the elements of Q which are linear combination 
of positive roots with nonnegative coefficients. 

The exponents {mi, m n } of the root system R verifies mi = 2i — l, i = 1, n when R is of type 
B n or C n and 

rrii = 2i — 1, i G {1, n — 1} and m n = n — 1 (5) 

when R is of type Z) n . 
Remarks: 

(i) : The integer n — 1 appears twice in the exponents of a root system of type D n when n is even. 

(ii) : The exponents mi,i = 1, ...,n — 1 are the same for the three root systems of type B ni C n or 
D n . 

As customary, we identify P the lattice of weights of G with a sublattice of {^L) n . For any (3 = 
(f3 1 , ...,/3 n ) G P, we set \(3\ = (3 1 + ■ ■ ■ + /3 n . We use for a basis of the group algebra Z[Z n ], the 
formal exponentials (e 13 )^^ satisfying the relations e f3l e f3 ' 2 = e^ 1+l32 . We furthermore introduce 
n independent indeterminates x±,...,x n in order to identify Z[Z n ] with the ring of polynomials 
Z[xi, x n , x^ 1 , x" 1 ] by writing e@ = xf 1 ■ ■ ■ Xn n = x@ for any (3 = ((3 1 , (3 n ) G Z n . 
Write s^ n for the Weyl character (Schur function) of V sln (X) the finite-dimensional 0[„-module of 
highest weight A. The character ring of GL n is A n = Z[xi, x„] sym the ring of symmetric functions 
in n variables. 

For any A G V n , we denote by the Weyl character of ^ S (A). Let R 9 be the character ring of G. 
Then 

R® = Z[xi, x n , x-^ , ...,x n ] 
is the Z-algebra with basis {s\ \ \ £V n }. 

In the sequel we will suppose n > 2 when = sp 2n or S02 n +i and n > 4 when = S02 n - 

For each Lie algebra = so N or sp N and any partition v G 'Pat, we denote by V^ N (u) lf N the 
restriction of V^ N (v) to 0. Set 

JV 



V$n(v) I = V S0N (Xf b ^ , (6) 



This define in particular the branching coefficients b s °^ and 6* |™ . The restriction map r is defined 
by setting 

z[xi,...,xjv] s y m -► i?s 



We have then 



r 0( s g[iv) = J [ S^ ljv (xi,...,x n ,x n 1 ,...,x 1 x ) when N = 2n 

\ Su 1n (xi, x n , 0, x" 1 , x^ 1 ) when N = 2n + 1 
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Let V n and Vh ' be the subsets of V n containing the partitions with even length rows and the 
partitions with even length columns, respectively. When v € V n we have the following formulas for 
the branching coefficients b B0 ^ and 6 p2 ? : 

Proposition 2.1.1 (see J2j/ appendix p 295) 
Consider v € V n - Then: 

where c 7 A is i/ie usual Littlewood-Richardson coefficient corresponding to the partitions 7, A and v . 
Note that the equality b s u °^ 1+1 = b s °"^ becomes false in general when v ^ V n . 

As suggested by Proposition 12 . 1 . fl the manipulation of the Weyl characters is simplified by working 
with infinitely many variables. In [6], Koike and Terada have introduced a universal character 
ring for the classical Lie groups. This ring can be regarded as the ring A = Z[x±, ...,x n , ... 
symmetric functions in countably many variables. It is equipped with three natural Z-bases indexed 
by partitions, namely 

B sl ={sf I A € V}, B sp ={sf I A e V} and £ so ={sf | A G V}. (7) 

We have in particular the decompositions: 

B * = E E C A,7 S A° and S* [ = £ £ C A,7 S A P - (8) 

AeP 7eP (2) AeP 7e7 ,(i,D 
We denote by y the linear involution defined on A by 

<p(si°) = sf,. (9) 

For any positive integer n, denote by A n = X[xi, x n ] sym the ring of symmetric functions in n 
variables. Write 

tt h : x n , ...] sym > x n ] sym 

for the ring homomorphism obtained by specializing each variable Xi,i > n at 0. Then 7r n (s?') = 
s^ n . Let 7r fip2n and ir s ° N be the specialization homomorphisms defined by setting 7r sp2ji = r Bp2n o ir^n 
and 7r SOjv = r s ° N o 7Ttv. For any partition A G "P n one has 

S *P 2 „ = ^(g^P) and ^ = 7r* "( B f ). 

When A ^ 7-V, we have 7T 3p2n (s* p ) = and 7r SOjv (s A ) = 0. The situation is more complicated when 
A G Vn but X V n , that is if d(A) the number of parts of A verifies n < d(X) < N. In this case one 
shows by using determinantal identities for the Weyl characters (see |6j Proposition 2.4.1) that 

vr sp 2-(sf ) = ±s* P2 ™, -K B02n+1 (s B x °) = ±s B v °^ +1 and ^"(sf ) = ±s s °* n 

where the signs ± and the partitions n B ,n c , rj D are determined by simple combinatorial procedures. 
Note that we have in this case \n x \ < \X\ for X = B,C, D. 

We shall also need the following proposition (see [6] Corollary 2.5.3). 
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Proposition 2.1.2 Consider a Lie algebra q of type X n € {B n ,C n ,D n }. Let A € V r and [i 6 V s . 

Suppose n>r + s and set 

V s (\) (8 V B (fi) = V s (uf d ^. 

Then the coefficients d\ do not depend on the rank n of q neither of its type B, C or D. 
Remark: The previous proposition follows from the decompositions 

■? x = E d i» s * p and s a° >< < = E d l»<° 

for any A, fi £ V, in the ring A. 
2.2 Lusztig g-analogues 

The g-analogue V q of the Kostant partition function associated to the root system R of the Lie 
algebra q is defined by the equality 



a£R+ H /3GZ" 



/ > n \ ' " 

qe 1 - 



Note that V? n {P) = if j3 £ Q + . Given A and \i two partitions of V n , the Lusztig q-analogues of 
weight multiplicity is the polynomial 

k im= E {-iy {w) v q (wo\-n). 

It follows from the Weyl character formula that K B (1) is equal to the dimension of V®(\). 
Theorem 2.2.1 (Lusztig fT^ ) 

For any partitions A, /U € V n , the polynomial K®^(q) has nonnegative integer coefficients. 
We write 

K IM = E K &- ( 10 ) 

k>0 

Then 

= E (-iy (w) V k (wo\-ri (11) 

where for any (3 € Z n , V k ((3) is the number of ways of decomposing [3 as a sum of positive roots. 
Remark: One verifies easily that K® (q) ^ only if A > /J,. Moreover, when \fj,\ = |A| , one has 

-^A/^( < ?) = ^Xu(l) w here K^(q) is the Kostka polynomial associated to (A, ,u), i.e. the Lusztig 
g-analogue associated to the partitions A, fi for the root system A n -±. 

We also introduce the Hall-Littlewood polynomials Q'®, /U £V n defined by 



= E K lM s > 



xev„ 
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2.3 The symmetric algebra S(g) 

Considered as a G-module, g is irreducible and we have 

so 2ri +i — V" (l, 1) and dim(so 2n +i) = n(2n + 1) 

sp 2n ~ V*{2) and dim(sp 2 J = n(2n + 1) . (12) 

S02n — V^ S (1, 1) and dim(s02 n ) = n(2n - 1) 

Let 5(g) be the symmetric algebra associated to q and set 

fe>0 

where S (g) is the fe-th symmetric power of g. By Proposition I2.1.T1 and (I12p . we have 

g ~ 1) lf» for = bo n and fl ~ V"^(2) jfc for = sp 2n . 

This implies the following isomorphisms 

S k (g) ~ 5 fe (ys^(l, 1)) for g = 50jv and S k (g) ~ 5 fe (y^(2)) for g = 6 p 2n . (13) 

for any nonnegative integer fc. 

Example 2.3.1 By using the Weyl dimension formula (see J3J/ page 303), one easily obtain the 
decompositions 

S 2 (V slN (l,l)) ~ F 8l "(l, 1,1,1) ©7^(2,2) 

and 

5 2 (yfl [ 2n(2)) ~ y0'2n(4) ©ys [ 2«(2,2). 
Hence by [22 and Proposition \2.1.1\ this gives 

S\g) ~ F 9 (l, 1, 1, 1) © y (2, 2) © 1/0(2, 0) © l/ (0) /or g = so^ 

and 

S 2 (sp 2n ) ~ y*P2« (4) © y Sp 2n( 2; 2) © F Sp 2n(l ; 1) © 7*^(0). 

Remark: By the previous formulas, the multiplicities appearing in the decomposition of the 
square symmetric power of the Lie algebra g of type X n € {B n , C n , D n } do not depend on its rank 
providing n > 2. We give in Proposition 13.1,1] the general explicit decomposition of S k (g) into its 
irreducible components. 

3 Graded characters 

3.1 Graded character of the symmetric algebra 

Let V be a G or GL n -module. For any nonnegative integer k, write S k (V) for the k-th. symmetric 
power of V and set S(V) = ®k>oS k (V). Then S k (V) and S(V) are also G-modules. The graded 
character of S(V) is defined by 

char q (S(V)) = char{S k (V))q k . 

k>0 
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Denote by W(V) the collection of weight of the module V counted with their multiplicities. Then 
we have 

char^OO) = II YZ~q 

0<=yv(v) 



The weights of the Lie algebra q of rank n considered as a G-module are such that 

W(q) = {ae R,0,...,0}. 

n times 

Thus the graded character char g (5'(g)) of S(g) verifies 



char,,,. , , , , 

qy y *' J (1 - q) n 11 1-qx 

Proposition 3.1.1 For any nonnegative integer k, we have 

char g (5 fe ( S0i v)) = £ £ b* v J s 



SOjv 

A 



char ? (S fc ( S p 2n )) = E 6 5 w 4" 2n 



where b s °^ and b^f* are the branching coefficients defined in f6jj. 
Proof. Suppose first g = 5p 2n - Recall the classical identity 

n i _ T . T . = e s ^ [2n 



X 4 X 4 

l<i<j<2n 3 vev (2) 



due to Littlewood. It immediately implies the decomposition 

n !_*. = E ^^-=E E 



l<i<j<2n- qXlX i V&J W k>O vep (V (2k) 



By applying the restriction map r sp2n , this gives 

_j_ n — — n — — 



From ([6|), this can be rewritten on the form 



char g (5( S p 2 J) = -i— J] Y 2 -; = E E E 



which gives the desired identity by considering the coefficient in q k . 
When q = so 2n+ i or q = so 2n , one uses the identity 



n T^Lr = E «-^=E E # 



and our result follows by similar arguments. 
In the sequel, we set 



E ^A and <A-= E b %r- 



Thus we have char g (5 fc ( S o^)) = £ A6n> <a and char 9 (S fe ( S p 2n )) = £ AePn 
3.2 Universal graded characters char 9 (S sp ) and charts 50 ) 

Proposition 3.2.1 Consider a nonnegative integer k and a partition A £ P m . Suppose n > 2k. 
Then we have the identities 



' - niTi" Yj E c a,7 ( 15 ) 



!/e-p( 1 > 1 )(2A:) jevw 



<r= E E <7- 

uev( 2 '>(2k) 7 e-p(i.i) 

In particular, the multiplicities rn s ^ x l , rn£ 2 x +l and rn^^ 1 do not depend on n. 

Proof. For any v € 7 ? jv(2A;) we have z/ € Vn(ji) since n > 2/c. We can thus deduce from 
Propositions 12.1.11 and 13.1.11 the decompositions 

m k,\ E E C M and m t p T = E E C A,7- 

Since c A7 = when |A| + | 1 ^ 2k, m a k ° x and m s k P x n can be rewritten as in (fT5|) and thus, do not 
depend on n. ■ 

We set 

m M = n H ^ m S n+1 = E E <7 and <A=^rn S fc P f = £ E C A,7" ( 16 ) 

^e-pti.i) (2k) 7 G-p( 1 . 1 ) !/e-p( 2 ) (2fc) 7 e7'( 2 ) 

Lemma 3.2.2 For any nonnegative integer k and any partition A, we have 

1 Sp so 

1. m* x = m s ° x , 

2. mf x = m 5 ° x = if |A| > 2k 

where rn B kX and m s ° x , are the multiplicities defined in 
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Proof. Write t for the bijective map defined on V by A i — ► A'. We have then l(V^>) = V^ 1 ' 1 ^ 
and i{V^ 2 \2k)) = V^ 1 ' 1 \2k). Moreover c A 7 = , for any partitions A, 7,1/. This implies 1 from 



the definition (|16p of ?t\ p a and wf° A ,. 
Recall that c A = when 7^ |A| + I7I . Since = 2k in the equalities of (fl6|) . we have 
mf A = mf A = if |A| > 2fc. ■ 



We define the universal graded characters char 9 (S sp ) and char g (S B0 ) by setting 

char 9 (S( S p)) = H — — - and char g (S( 5 p)) = J] ■ (17) 

Note that char g (S sp ) and char g (S S0 ) belong to the ring jt[[q]] of formal series with coefficients in A. 
For any F = Xlfc>o c kQ k in -MM]' the specialization homomorphisms 7r sp2 « , 7r S02n+1 and 7r S02n are 
then defined by setting 

tt0(F) = J>«(c*)<A (18) 

fc>0 

By dHJ) and (HID, we have then 

vr SOjv (char (? (S(5o))) = char,(S(sojv)) and 7r sp2 "(char g (S(sp))) = char,(S(sp 2n )). (19) 
Similarly, the linear involution (p (see ([9])) is defined on A[[q]] by 

(20) 

fc>0 

Observe that {q k sf \ k G N, A G V}, {q k s s x ° \ k G N, A G and {g fc s A ° | A; G N, A G V} are Z-bases 
of A[[g]]. 

Proposition 3.2.3 PFe have the decompositions 

char 9 (S( S o)) = £ J] < A sfg fc and (21) 
fc>o AeP 

char (? (S( S p))=^^m^s A V. 

A:>0 AeP 

Proof. One can write 



charge)) = [I -^—T. = E E 



(rrr _ _ • _^<A"SV 

l<i<j q 1 3 k>0 ^ e p(i,l) [2k] k>0\£V 



char^SM) = n Y^—T. = E E ■&* = ££ 



Sp Sp fe 

i<«<i " ^ X * X J fe>o^ e -p(2)[2fc] fe>0AeP 



where the rigthmost equalities follow from ([8]). ■ 

By using 1 of Lemma 13.2.21 one derives the following corollary : 

Corollary 3.2.4 We have (/?(char g (S(so))) = charts (sp)). 

Remark: By 2 of Lemma f3.2.2|, one has 

chax,(S fe (so)) = E <aS S a° and char 9 (S fc (sp)) = E <A S ? ( 22 ) 
Ae-P[2fc] xev[2k] 

where V[2k] is the set of partitions A such that |A| < 2k. 
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3.3 Universal graded character for harmonic polynomials 

Let g be a Lie algebra of type X n € {B n , C n ,D n }. Since the symmetric algebra S(g) can be regarded 
as a G-module, one can consider 

S(q) G ={i£ 5(fl) | g ■ x = x for any g £ G} 

the ring of the G- invariants in S(q). By a classical theorem of Kostant [6j we have 

S(q) = H(q)®S(q) g (23) 

where H(q) is the ring of G-harmonic polynomials. The ring S(q) g is generated by algebraically 
independent homogeneous polynomials of degrees d{ = + 1 and the graded character of S(q) g 
considered G-module verifies 



qdi 
i=i H 



n 

char g (5( ) G ) = n — 

i= 

By (|23p the graded character of H(q) can be written 

charts)) = ^gffj) = fh 1 ~ «*) char g (S(s)) = ^char(H*(fl))g*. (24) 

We define the universal graded characters char,j(iif(sp)) and chax q (H(so)) by setting 

char,(H(so)) = J](l-g2i )charg(s(so))= -Q (1 _^ ) 1_ (2g) 

i>l i>l l<i<j J 

char,(H( S p)) = -q 21 ) char q (S( 5 p))=H(l- q 2i ) JJ ^ 



<>l i>l l<i<j " 9X<Xj 



The universal characters char g (S(5p)) and char g (S(so)) belong to A[[g]]. Moreover n»>i(l ~~ I 21 ) e 
A[[g]] since it is a formal series in q with integer coefficients. Hence char g (H(sp)) and char g (H(so)) 
also belong to A[[g]]. We set 



char,(H( S p)) = ^^^5 fc s s A Vand 

k>o\ev 

char 9 (H( S o)) = EE^^iV- 



fe>0 \GV 

Lemma 3.3.1 For any nonnegative integer k, we have 

char g (H fc ( S o)) = Y, K^sx and char, (E k ( 5 p)) = £ Kjfsf. (26) 
AeP[2fc] Ae-P[2fc] 

Moreover, for any nonnegative integer n > 2k 

^ 0jv (char g (H fe (so))) = char q (H k (so N )) and ^(char 9 (H fc (sp))) = char g (F fc (sp 2n )). (27) 
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Proof. By definition of the coefficients K™'* , we have 

char 9 (H fc ( S o)) = ^^° fc sr. (28) 
xev 

Write [k/2] for the quotient of the Euclidean division of A; by 2. Then by (I25p . is the coefficient 

of in q k s x ° appearing in the expansion of 

[fc/2] fe 

i>k = II C 1 - «*) E 9 a cha r(? (S a ( S o)) (29) 

i=l a=0 

on the basis {g fc s^ | k € N, A € P}. Indeed, for any i > [k/2], we have % > k. By ([22]) . 

ehar g (S a (so)) = £ m&B? 

Ae-P[2a] 

for any nonnegative integer a. Since the integers a appearing in (1291) as lower than k, we have by 
2 of Lemma 13.2.21 m B °\ = for any partition A such that |A| > 2k. Hence, the coefficient of ip k on 
q b s^ is equal to when |A| > 2k. This permits to consider only the partitions of V[2k] in the sum 
(j28|) and yields (f26|) . The proof is the same for char g (H fc (sp)). 

We have seen that char g (H fc (so) is the coefficient in q k of Now for any rank n > 2k, chai q (H k (so at)) 
is the coefficient of q k in 

[fc/2] 

0fc = II ( : - «*) E ^char,(^( SOw )) 

i=l a=0 

Indeed we have 

n 

charg(F(50Ar)) = JJ(1 - <? dl ) char f ,(S , (so 7 v)) 

i=l 

and for any i > [k/2], d { > k. By CED, we know that 7r SOjv (char (? (S a (so)) = chax q (S a (so N )). Thus 
this gives the equality 7r s ° N (tp k ) = 4> k . Hence we have 7r st,JV (char 9 (H fc (so))) = char q (H k (so at)). 
The proof is similar for char g (H fc (5p)). ■ 

Remark: Since (|27p only holds for n > 2k, we have 

vr S0jv (charq(H(50))) ^ chav q (H(so N )) and vr sp2 " (char g (H(sp))) / char 9 (#sp 2n )) 

i.e. there does not exist identities analogous to (fT9j) for the char g (H(so)) and char g (H(sp)). 

4 Stabilization of the coefficients K^, 

A, [1 

4.1 Stabilization of the coefficients Kj£« 

The theorem below shows that the coefficients of the expansion of chai q (H(Q)) on the basis of Weyl 
characters are the Lusztig g-analogues associated to the zero weight (i.e. fj, = 0). 
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Theorem 4.1.1 (Hesselink JJ$) We have 

char 9 (tf ( )) = £ Kl 9 ( q )s° = £ £ 
AePn fc>o AeP„ 

T/ie multiplicity of V S (X) in the decomposition of H k {o) in its irreducible components is equal to 
A AJ- 



Now fix a nonnegative integer k and choose a rank n > 2k. The partitions A appearing in (|26 
verify |A| < 2fc. Hence they belong to V n for n > 2fc. Since tt BOn (sf) = s s ° N and n s ^(sf) = S *P2, 
for any \ £ V n this gives 

(char g (H fe ( S o))) = Y, KS xt s T and ^ P2 "(char,(H fc ( S p))) = £ K^ fe S f ». 



By using (|27j) . one obtains 

char^so*)) = £ and char 9 (^( S p 2n )) = £ K^ fe S f (30) 

\ev n xePn 

We can now state the stabilization result for the coefficients K®'*. 

Proposition 4.1.2 Let m, k be nonnegative integers. Consider A € V m and q a Lie algebra of type 
X n G {B n ,C n ,D n }. Suppose n > 2k, then 

A,0 _ A A,0 ana A A,0 _ A A,0 _ A A,0 ' 

In particular the coefficients K^ n,k , K^ n+1 ' k and K B °^ n ' k do not depend on the rank n. 



Proof. By Theorem 14 . 1 . 1 1 we have 

char 9 (^( S0iV )) = K t7' ks X N and char g (^( S p 2 J) = £ K^ k s^. 

xev n xev n 

The Proposition then comes by identifying the coefficients appearing in these decompositions with 
those appearing in ([301) . ■ 



Thus the coefficients depends only on A, k and the type X = C or X 6 {B,D} of the Lie 
algebra considered when rank(g) > 2k. Proposition 14.1.21 can also be rewritten on the form 

lim K?^ k = and lim K?°»> k = K*°X k . 
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4.2 Recurrence formulas for the Lusztig g-analogues 

We now recall recurrence formulas established in [12] and [13] which permit to express the Lusztig 
(/-analogues associated to the root system of type X n G {B n ,C n , D n } in terms of those associated 
to the root system of type X n -\. They can be regarded as generalizations of the Morris recurrence 
formula which holds for the Lusztig (/-analogues of type A. 

Suppose q is of rank n and consider v G V m with m < n. For any nonnegative integer I, the 
decomposition of the g-module V®{v) <X> V s (l) into its irreducible components can be written 

y ( 7 ) ® V S {1) ~ V*(\f p *J. 
\eV n 

This decomposition can be regarded as the analogue of the Pieri rule in type X n . 

Remark: The multiplicities p®'^ are not necessarily equal to or 1 as in the original Pieri rule 

(i.e. for g[ n ). Moreover we can have p®'^ ^ when |A| < | 7 | + I. Nevertheless, when |A| = [7I + I, 

one shows that the Pieri rule for type X n coincide with the original one. It means that p®'^ = 1 
if A is obtained by adding an horizontal strip of length I to 7 (i.e. the I boxes of A/7 belong to 
distinct columns) and p®^ = otherwise. 
The following Lemma is a consequence of Proposition 12.1.21 

Lemma 4.2.1 Consider 7 G V m and I G N. Suppose that q is a Lie algebra of type X n G 
{B n ,C n , D n } with n > m. Then the multiplicities p®'^ are independent of the rank n and the 
typeX£{B,C,D}ofQ. 

We set 

Pu,l = lim Pjw- 

Let n G V m . Write p maximal in {1, m} such that u p — p — fj, x + 1 > 0. For any s G {1, ...,£>} let 
7 (s) be the partition of length m — 1 such that 

( \ = J ( v 2,-,Vm) if s = 1 . . 

1{S> \ (i/i + l,i/ 2 + l,...,i/ a _i + l,i/ a+1 ,...,i/ TO )if«>2 ' 1 ' 

Finally set 

R s = u s -s-pL x + l. (32) 

Theorem 4.2.2 Jltf 

With the above notation, we have for any partitions A,/i £ V m : 

(i) : K%r»(q) = ^(-ir 1 x « Rs x E E ^v'X?"^ 

s=l r+2a=R s AsPm-l 

( ii ) : ^(^) = E(- 1 ) s " 1 x E « r+a E <(S; 2,A <?" (9) 

8=1 r+2a=R a XeV m -i 

(iii):^w = E(- i r 1 x^ s x E E <S),; 2 X?" 2 ^ 

s=l r+2a=i? s XeVm-l 

where a G N and /i 1 ' = (p 2 , • •■> Mm)- 
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By using similar arguments to those given in Example 4 page 243 of [15] , one shows that the 
polynomials K® (q) are monic of degree 

E?=l(n - * + l)(Ai - Hi) for g = so 2n+ i 
E2=i(n-*' + l/2)(At-A*i)forfl = ap2n • 
E"=i( n - 0( A i - Mi) for = so 2n 

Thank to the recurrence formulas of Theorem 14, 2. 2\ one can derive a lower bound for the lowest 
degree appearing in Ky )tl {q) when K$ tfl (q) ^ 0. 

Proposition 4.2.3 For any partitions u,fj, G V n , K®,^ {q) = or has degree at least . 

Proof. We give the proof for g = sp 2n , the arguments are essentially the same for g = so 2n+1 
and g = so 2n . We proceed by induction on n. For n = 1, one has K* p fr(q) = or K^(q) = g 1 2 ImI . 

Now suppose K^* 2 ™ -2 (g) has degree at least ^ J M i or is equal to 0. Consider i/,/i£P„ such that 
^ P /? n (g) / 0. We apply recurrence formula (ii) of Theorem 14.2.21 Since Kt P ji n {q) + 0, there exist 
integers s and r < R s such that if* p2 ™~ 2 (g) ^ with P*^~ 2 ' A / 0. One then have |A| > |-y(s) | — r. 
The definition (I31D of 7(5) gives |7(s)| = \v\ — u s +s— 1. By the induction hypothesis, the polynomial 

\X\ - + fl x I \v\ -u s + s - 1 - \fl\ +/J, 1 

d = r + a H > -r + a H . 

2 ~ 2 2 

One other hand, we have \r + a = for r + 2a = i? s . Recall that i? s = v s — s — + 1. This 
finally gives 

^ > U s - S - ^! + 1 |^| - ^ + S - 1 - |^| + ^ > - |^| 



Remark: By the previous proposition, the coefficients K®'^ are all equal to zero when k < ^ ^ . 
This implies in particular that we have the decomposition 

= E = E E ( 33 ) 

veVn k>0 ueP n [2k+\fi\] 

for the Hall-Littlewood functions Q'®. 

Since the integer p and the partitions 7(3) defined above do not depend on the rank of g, we 
obtain from Lemma 14.2.11 and Theorem 14.2.21 : 



Corollary 4.2.4 (of Theorem ^. 2. 2\j 



For any partitions A, \i G V m and any integer n > m 

(i):K^(?) = E(-i) s - 1 x^x e E Pi(s),rKT 1{q) 

s=l r+2a=R s AsPm-l 

(ii):^w = E(-i) s - 1 x e i r+a E *4),r<;r 2 ^ 

s=l r+2a=-R s AeP m -i 

(iii):^(g) = E(-ir 1 x^ s x E E ^),^r?" (9) 

s=l r+2a=H s \&V m -i 
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where a G N and ^ = (/i 2) .-,/iJ. 

The Lemma below will be useful to derive the recurrence formulas of paragraph 

Lemma 4.2.5 The partitions A appearing in the right hand sides of the previous formulas for 
which there exists a pair (7(5), r) such that P^r s \ T must verify one of the following assertions: 

1. A = v and then fj, = 0, s = 1, r = R\ = v\, j 1 = v , 

2. |A| < , 

5. |A| = \v\ with A/y and then fi = and 

in particular |A| = |z^[ on/y = 0. 

Proof. Consider A and (7(5), r) such that P^r s \ r 7^ 0. We must have |A| < r + |7(s)| = 
R s - (R s - r) + |7(s)| . By definition of R s ([32]) and 7(a) flM]) we obtain |A| < \v\ - Mi - (^s - r). 
Thus |A| < when /i 7^ and |A| = |^| only if /i = and r = R s . This permits to restrict ourselves 
to the case when fi = 0, |A| = \i>\ and r = 

Suppose first A = v. Then we must have s = 1. Otherwise 7(3)1 = v\ + 1 and we would have 
Ai > v\. This gives \i = 0, s = 1, r = R\ = i/i and 7^ = as desired. 



A fc 



< if and only if Ai > v\. When s > 1, 



Now suppose |A| = |z/| with \ ^ v. Observe that 

we have 7(5)1 = V\ + 1 > z/i, thus Ai > v\ (see Remark before Lemma l4.2.ip . When s = 1, we 
have 7(1) = (1^2, ^n) = ^ and r = z^i- Since |A[ = \u\ and 7^ 0, A is obtained by adding an 

horizontal strip of length tq on zA This implies Ai > v\ because the number of columns in v 9 is 
equal to ^2 < ^1 and we have assumed A 7^ za m 

4.3 Stabilization of the coefficients Kf k 

Theorem 4.3.1 Consider m a nonnegative integer and two partitions such that v G V m and 
fi G V a . Let q be a Lie algebra of type X n G {B n ,C n , D n } and k a nonnegative integer. Then for 
any n > 2k + a, the coefficients K„ t k do not depend on the rank n of q. Under these hypothesis, we 
have moreover K^ n+1 ' = K*°jl n ' k . 

Proof. Suppose first q = so 2n+ i- We proceed by induction on a. Note that we can suppose 
a < m, otherwise K*°^ n+1,k = for any rank n. If a = 0, then /x = and the theorem follows 
directly from Proposition 14.1.21 Suppose now our theorem true for any partition $ of length a — 1 
with 1 < a < m and consider fi a partition of length a. We then apply the recurrence formulas of 
Corollary |4.2.4[ It follows from (|32p that the integers R s appearing in these formulas do not depend 
on the rank n considered. This is also true for the multiplicities P^( s \ r - 

By our induction hypothesis, for any p£N, the coefficients j^ 302 "- 1 ^ are independent on n. Indeed 

/j, G V a -i and S02n-i has rank n — 1 > 2k + a — 1. The recurrence formulas of Corollary 14.2.41 imply 
that each coefficient Kf,°a n+1 ' can be expressed in terms of the coefficients K s ° 2 ™~ 1,p , the integers 

R s and P^/ s \ r - Moreover, this decomposition is independent of n. Hence K^ n+1,k does not depend 

on n. By using similar arguments, we prove that K§'u do not depend on n when g = 5p 2n or so 



•hi- 



ll 



The equality K*°£ n+1 ' k = K*°[i"' k is yet obtained by induction on a. It is true for a = by 
Proposition 14. 1 .21 and the induction follows from the fact that the recurrence formulas of Corollary 
14.2.41 are the same for S02n+i and 502 n - ■ 

Remark: The arguments used in the previous proof imply that it is possible to decompose any 
Lusztig g-analogue Kv^{q) such that \i ^ in terms of the Lusztig q-analogues K^(q). Moreover 
this decomposition is independent on the rank n providing this rank is sufficiently large. In this case 
the decomposition is the same for K v ^ +1 {q) and K*°j* n (q). Nevertheless, these two polynomials 
do not coincide since K^ n+1 (q) ^ K*°% n (q) in general. The previous Theorem also establishes the 
equality Kt°^ n+1 ' k (q) = K*°j ! l n ' k (q) for any k < where a is the number of nonzero parts in [i. 

By Theorem 14.3. H it makes sense to set 

K s v f = lim K*°^ k = lim K^ k and Kg* = lim K^ k . (34) 

4.4 A reformulation in terms of the Brylinski-Kostant nitration 

Recall that the Lusztig g-analogue K® (q) can also be characterized from the Brylinski-Kostant 
filtration on the weight space V r0 (A) AJ pp. Take e = e\ + • • • + e n G u + for a principal nilpotent in 
g compatible with f). The e-filtration of V s (A)^ is the finite filtration J e (V 8 (X) fJi ) such that 

{oicjMa^cjMaWc-. 

where for any nonnegative integer k, 

J^(V e (X),) = {v G ,\ e k+l (v) = 0}. 

For completeness we also set J~ 1 (y (A) At ) = {0}. The following theorem is a consequence of the 
main result of pQ. 

Theorem 4.4.1 (Brylinski) Consider m a nonnegative integer and A,/i G V m . Let q be a Lie 
algebra of type X n G {B n , C n D n }. Then 

K IM =Y, d ^ J e( VS ( X )»)/ J t 1 (V°(\),))q k . (35) 

A:>0 

By using Theorem 14.3.11 the dimension of the space J k (V s (X) IM ) does not depend on the rank n of 
g providing n is sufficiently large. More precisely, we have : 

Theorem 4.4.2 Consider A G V m , fj, G V a and k G N. Let g be a Lie algebra of type X n G 
{B n , C n D n } with n > 2k + a. Then dim( J k (^ B (A)^)) is independent of the rank n of g. Moreover 
we have in this case 

dim(J e fc (y S02 "+ 1 (A) M )) = dim(J e fc (y S02 "(A) M )). 
Proof. We deduce from Theorem 14.3.11 and (I35p that the coefficients 
K*£ = dim(J e fc (^(A) M )) - d\m(JtHV s (\),)) 
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does not depend on n providing n > 2k + a. Under this hypothesis, one can write 

k k 

dim(J e fc (y— (AV)) = Y, K IT and dim(J e fc (V^-(A) M )) = £ 

a=Q a=Q 

Hence dim(Jg (V B ° N (X)^)) and dim( (U sp2n (A)^)) are independent of n. Moreover, we have 

dim(J e fc (y S02 "+ 1 (A) M )) = dim(J*(y s ° 2 ™(A) M )). 



Remark: In general, the spaces J^(V S (X)^ depend on the rank n > 2k + a considered although 
their dimension does not. An interesting problem could consist in the obtention of explicit bases 
for the weight spaces Jg (V^ (A) M ). 

5 Limit of Lusztig g-analogues 

5.1 The formal series K*° (q) and (q) 

The results of Theorem 14.3.11 suggest to introduce the formal series K^^q) and (q) defined by 
K{°M = £*2?9* G N[[fl]] and K^(q) = ^XjV e 1%]] 

r>0 r>0 



where the coefficients -K"^ and K^' are those defined in ([Ml)- Then, (?) and ifj (g) can be 



regarded as the limits of the Lusztig g-analogues K*°"{q) and K?^(q) when the rang n of g tends 



to the infinity. 
We have moreover 

char 9 (H( S0 )) = £ K s ^(q)sf and char 9 (H( S0 )) = ]T K%(q)B?. (36) 

Remarks: 

(i) : When g = sp 2n or S02n, K\ ^(q) = for any partitions A,/x such that |A| — \fi\ is odd. Thus for 
such partitions we have also (q) = K^°^(q) = 0. 

L \,fJ, 



(ii) : Observe that we may have K s ° 2 ™ +1 (q) even if |A| — \/j,\ is odd. In this case we have thus 



lim K s x ° 2 u n+1 ' k (q) = (37) 



any rank n > 2. Thus (|37p is verified for any fixed degree k. 



^(1),0 



for any nonnegative integer A:. Take as an example A = (1) and \i = 0. Then i^f. , 2 !^ 1 (g) = q n 1 for 
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5.2 Recurrence formulas for the series K^^q) and '(g) 

By taking the limit when n tends to the infinity in the formulas of Corollary 14.2.41 (which do not 
depend on n), we obtain the identities 

^(?) = E(-ir 1 x^x E £*W%(9) ( 38 ) 



k?Aq) = E(-i) 



s-l 



r+2a=R. 



r+2a=i? s AgT 7 



~ a E 



where a G N and ^ = (/i 2 ,...,/i m ). These identities yield recurrence formulas for the limit of 
(/-analogues. 

To see it, suppose first // 7^ 0. By Lemma [4.2.5|, the formal series K so b (q) and K s b (q) appearing 
in the right hand sides of f|38[) are such that |A| < . Thus formulas (|38p permit to express the 
series K*° u (q) and K^ u (q) respectively in terms of the series K^°^ b (q) and K^ iib (q) with |A| < 



x,^ 



\v\. 



Now suppose [i = 0. Then by Lemma KZM K^{q) and #f (g) also appear in the right hand side 
of (f38|) when 7(5) = 7(1) = v* , R s = R\ = v\. We can write 



1 



p-i 



V 



r+2a=v 1 X&P 



s=2 



Rs V ...A 
r+2a=_R s AeP 



/ 



and 



(39) 
\ 



E ^E^^fe) +£(-*: 

xev 



s-l 



E « r+a E 



p 



A 

7(s),r- I1 -A, 



s=2 



-2a=R s 



xev 



J 



where the series K^°Jq) and K^(q) appearing in the right hand sides are such that |A| < \u\ or, 
|A| = \v\ and A^ < \^\- Thus formulas ([5U|) permit to express the series K^(q) and K* p a (q) 
respectively in terms of the series K?°Jq) and K^Jq) with |A| < \u\ or, |A| = \u\ and 



< M 



Observe that |A| + 



Hence one can compute the series K^^q) and K^(q) by 



induction on |z^| + \ u \ starting from the obvious identity K^(q) = K^^q) = 1. 



It thus follows from the previous arguments that the series K*°^(q) and Kf^^q) with \i ^ can be 
computed by induction on \v\ from the series K^(q) and K^(q). The series K^(q) and iT^^g) 
being obtained by induction on \v\ + from K^(q) = K^(q) = 1. We give in Proposition 15.4.11 
explicit formulas for K^(q) and K*^(q) when v is a row or a column partition. 



5.3 A duality between the series K^(q) and Ky Jq). 
Proposition 5.3.1 For any partition A we have the duality 



20 



between the limits of the orthogonal and symplectic Lusztig q-analogues corresponding to the weight 
0. 

Proof. We have 

char 9 (H(so)) = J^[(l - q 2i ) char 9 (S(so)) and char 9 (H(sp)) = ]J(1 - q 2i ) char g (S(sp)). 

i>l i>l 

Moreover by Corollary 13.2.41 <£>(char g (S fe (so))) = char g (S fc (sp)) for any nonnegative integer k. This 
implies the equality 

V3(char 9 (H fc (so))) = char ? (H fe (sp)) for any k G N. (40) 

Recall that 

char ? (H fe ( S0 )) = ^ and char 9 (H fc ( S p)) = £ J^s* 

By using (f40|) . this gives 

char 9 (H*( 5 p)) = £ K^sf = £ 

AeP Ae-P 

Since the map 




is bijective, we must have K^^(q) = Ky'~(q) for any nonnegative integer which proves the 
proposition. ■ 

Remark: The duality of the previous theorem does not hold for the Lusztig (/-analogues, that 
is K^ n (q) = K B ° 2 " +1 {q) in general. Nevertheless we have K s *$ n ' k (q) = K s ° N ^ k (q) when k < § 
according to Proposition 14.1.21 

5.4 Some explicit formulas 

We give below some explicit formulas for the series K*°^(q) and K*^(q) when v is a column or 
a row partition. Note that we have not found such simple formulas for the Lusztig g-analogues 
Ku,fj,(q) even in the case when v is a row or a column. 

Proposition 5.4.1 Consider I a nonnegative integer. Recall that (21) and (l 21 ) are the row and 
column partitions of length and height 21, respectively. We have 

Proof. We only give the proof for the first equality of the proposition. The proof for the second 
is similar. 



115=1(1-9*) 
q 21 

nti(i-<? 2i ) 
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We use the recurrence formula (f39|) . We have then p = 1, R\ = 21 and 7(1) = 0. Thus P^m r 7^ 
only when A = r and in this case P^n) r = 1- This yields for any I > 1 

y r+2a=2/ y 6=0 

where the last equality is obtained by setting r = 26. By an immediate induction starting from 
KT'Jq) = 1, one derives the desired formula 

*8)/«) = ni =1 (i-g«) 

by using the identity 

I-l «-i „26 -, 

fe =o 6=0 n^iCi-r 1 ) n^iii-r 1 ) 

We deduce then ^TJn 0(9) = Kf\2i\ 0(9) fro m Theorem 15.3.11 ■ 

Corollary 5.4.2 Consider m a nonnegative integer and fi a partition with d nonzero parts. Then 

1. KfK(q) / and Kf^ (g) ^ on/y i/m- |/x| E 2N. In this case 

Kf\ (q) = q^K?* Jq) = and Kf°, Jq) = q h{fl) K?° n Jq) = 

2. Kf° m s M (g) 7^ and ^(q) 7^ onh/ = (l p ) m - p G 2N and in i/iis case 



where I = m J p \ . 



Proof. 1 : We proceed by induction on d the number of nonzero parts of [i. If d = 0, the result 
follows from Proposition 15.4.11 Suppose b > and apply the recurrence formula (I38p . We have 
p = 1, Ri = m — fA± and 7(1) = 0. This gives 

K l),M= E i r+a K)A^ 

r+2a=m—fi 1 

Since iT 9 ^ b (g) = when r < , we can suppose r > in the previous sum. This gives by 
using the induction hypothesis 

r+2a=m—n 1 



22 



We must have r — ur € 2N, thus we can set b = — ^ — -. One then obtains 

= E ^^^fo) = E ^l>) 

6=0 6=0 

where the last equality follows from the equalities I = m and h(fi) = h(p°) + — By using 
([53"]) . this gives 

iTfP ( 9 ) = x ^ = ? *0»)^ ( g ). 

The proof is similar for Kf^ ^ (q) . 

2 : By applying ([38]) . we obtain this time p = 1, R\ = and 7(1) = 0. Hence 

By an immediate induction, this gives K^ m ^ ^(q) = K^ m _ p ^ ^(q) = Kjf 2l , ^(q) and our formula 
follows from Proposition 15.4.11 ■ 

6 Hall-Littlewood polynomials in infinitely many variables 

6.1 The ring of graded universal characters 

We now consider the ring A generated over Z [[<?]] by the formal characters s® [ , X £ V with multi- 
plication defined by 

*f ■ "J = E C K,4 

and for any pair F = ^AeP C X s \i G = X^eP C ^ 

F - G = E E C >P^t 

Observe that F ■ G is well defined since we have c\ = if \v\ ^ |A| + |mI an d thus ^ A e -p C\C^d^ 

is finite. Then B Bl = {af | X € V}, is a Z[[g]]-basis of A. We then defined the Z[[g]]-bases 
B so = {sf \ XeV} and B 5 ? = {sf \ X G V} so that flS} is verified. We then write < •, • > so and 
< •, • > sp respectively for the inner scalar products which make the bases B B0 and £> sp orthonormal. 

6.2 Hall-Littlewood polynomials in infinitely many variables 

For any partition fx, we set 

C = E ^» s i° and tf p = E K x,M s ? • 

AeP AeP 

Since Kff^q) = K^^{q) = when A < \i for the usual order on partitions, the transition matrices 
of the families {Q^° | A € V} and {Q^ p | A G V} respectively on the bases B B0 and B Bp are 
upper-unitriangular. Hence {Q^ | A € V} and {Q? p | A € "P} are bases of A. 
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We then define the basis {Pf | A G V} (resp. {Pf | A G P) as the dual basis of {Q' A S0 | A G £>} (resp. 
{Q^ p [ A G T 3 }) with respect to < • > so (resp. < •, • > Bp ). Then P A ° and P A P can be regarded as 
Hall-Littlewood polynomials in infinitely many variables. One has the identities 

s i° = E K l°A<iK and S T = E K&foW 

Remark: 

(i) : One cannot obtain Hall-Littelwood polynomials Q A in infinitely many variables by considering 
the limit when n tends to the infinity in (|10j) and pip . Indeed, the number of ways of decomposing 
a weight j3 as a sum of positive roots (where k is a fixed nonnegative integer) may strictly increase 
with n. As an example for k = 2 we have 1e\ = (ei — Ej) + (ej + e«) for any i G {2, n}. 

(ii) : Recall that the Hall-Littlewood polynomial P® (see [IT]) associated to the partition \i is defined 
by 

where W#( g ) = E^ e 

w b q ( w > with the stabilizer of fj, in W s . Since the number of elements of 
W B of fixed length strictly increase with the rank of q, the polynomials Wff(q) have no limit in 
Z[[g]]. This implies that is not possible to define Hall-Littlewood polynomials in infinitely many 
variables by taking the limit when n tends to the infinity in (|44p . 

(iii) : Similarly to (j33|) . we have the decompositions 

QT = E^» S *° = E E *23Wand 
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